Outline compiler #6114

kasiaMarek · 2024-02-13T12:54:42Z

connected to: #917

tgodzik

Thanks for working on this!

Let's also add a user setting to enable the new logic.

mtags-interfaces/src/main/java/scala/meta/pc/CompilerFiles.java

mtags/src/main/scala-2.12/scala/meta/internal/pc/Compat.scala

tgodzik · 2024-03-10T15:37:14Z

mtags/src/main/scala-2/scala/meta/internal/pc/MetalsGlobal.scala

+  val richCompilationCache: TrieMap[String, RichCompilationUnit] =
+    TrieMap.empty[String, RichCompilationUnit]
+
+  // for those paths units were


We should add a bit more to the comment here

kasiaMarek · 2024-03-19T10:31:29Z

metals/src/main/scala/scala/meta/internal/metals/OutlineFilesProvider.scala

+
+  def successfulCompilation(): Unit = {
+    wasSuccessfullyCompiled.set(true)
+    changedDocuments.clear()


Note: that this doesn't account for possible changes before compilation end is reported, it may not 100% reflect the state of files that was during compilation.

mtags-interfaces/src/main/java/scala/meta/pc/OutlineFiles.java

kasiaMarek · 2024-03-19T10:36:30Z

metals/src/main/scala/scala/meta/internal/metals/OutlineFilesProvider.scala

+          .asJava
+      Some(
+        OutlineFiles(
+          allFiles,


We may want to cap the number of files for initial compilation, so it won't take too long.

We can do a high number like 300 or something

kasiaMarek · 2024-03-20T13:20:19Z

Failing Scala3 NIGHTLY test is a test-only problem, so it shouldn't block this PR.

metals/src/main/scala/scala/meta/internal/metals/InteractiveSemanticdbs.scala

mtags/src/main/scala-2.12/scala/meta/internal/pc/Compat.scala

mtags/src/main/scala-2.13.8/meta/internal/pc/Compat.scala

tests/unit/src/test/scala/tests/CompilersLspSuite.scala

metals/src/main/scala/scala/meta/internal/metals/Compilers.scala

metals/src/main/scala/scala/meta/internal/metals/OutlineFilesProvider.scala

tgodzik · 2024-04-17T16:13:49Z

mtags/src/main/scala-2/scala/meta/internal/pc/MetalsGlobal.scala

+      else false
+    }
+
+    // TODO the same in autoimports TEST


Do we check auto imports? Is the TODO still relevant?

I added tests, this seems to be already handled

tgodzik

Some minor comments, but I also tested it on Metals codebase this workflow seems to break:

Add non compiling method to the MD5 object in mtagsShared
Change the name of MD5 to MD55
Try to auto import MD55 in another package.
We get completions for MD5 aside from MD55 and something like MD55.<local>

Could you take a look if you can reproduce it?

tgodzik · 2024-04-22T14:52:17Z

metals/src/main/scala/scala/meta/internal/metals/Compilers.scala

@@ -101,6 +104,10 @@ class Compilers(

  import compilerConfiguration._

+  val plugins = new CompilerPlugins()


Suggested change

val plugins = new CompilerPlugins()

I don't think it's used here now.

tgodzik · 2024-04-22T14:53:42Z

metals/src/main/scala/scala/meta/internal/metals/Compilers.scala

-              s"no build target found for $path. Using presentation compiler with project's scala-library version: ${scalaVersion}"
-            )
-          Some(fallbackCompiler)
+        case None => Some(fallbackCompiler)


Why remove this?

tgodzik · 2024-04-22T14:55:35Z

metals/src/main/scala/scala/meta/internal/metals/OutlineFilesProvider.scala

+    } provider.didChange(path)
+  }
+
+  def getOutlineFiles(id: String): Optional[JOutlineFiles] =


What is this id? Should we use BuildTargetIdentifier here? Or at least add an alias.

It is BuildTargetIdentifier, I'm constructing it here.

def getOutlineFiles(id: String): Optional[JOutlineFiles] = getOutlineFiles(buildTargetId(id)) def getOutlineFiles( buildTargetId: Option[BuildTargetIdentifier] )

It's just that it comes as a string from pc (can't be BuildTargetIdentifier, because pc interface doesn't depend on bsp4j) and it's less boilerplate to map it here instead of each place in Compilers.

tgodzik

Let's wait for the next release and merge it right after.

Great work!

…ers`

kasiaMarek force-pushed the outline-compiler branch from dd965c4 to e5982ab Compare February 13, 2024 14:18

kasiaMarek requested a review from tgodzik February 27, 2024 14:44

tgodzik requested changes Mar 10, 2024

View reviewed changes

kasiaMarek force-pushed the outline-compiler branch from 34ac473 to f3967a7 Compare March 19, 2024 10:12

kasiaMarek commented Mar 19, 2024

View reviewed changes

mtags-interfaces/src/main/java/scala/meta/pc/OutlineFiles.java Show resolved Hide resolved

kasiaMarek commented Mar 19, 2024

View reviewed changes

kasiaMarek force-pushed the outline-compiler branch 2 times, most recently from 6675382 to d1060a8 Compare March 20, 2024 08:03

kasiaMarek requested a review from tgodzik March 26, 2024 16:15

tgodzik reviewed Apr 16, 2024

View reviewed changes

kasiaMarek force-pushed the outline-compiler branch from 8c58a4c to 5cd84e8 Compare April 17, 2024 12:29

tgodzik reviewed Apr 17, 2024

View reviewed changes

kasiaMarek force-pushed the outline-compiler branch from 5cd84e8 to 56d4ce5 Compare April 19, 2024 09:33

kasiaMarek marked this pull request as ready for review April 19, 2024 11:39

kasiaMarek requested a review from tgodzik April 19, 2024 11:52

kasiaMarek force-pushed the outline-compiler branch from dd3c21e to 1499749 Compare April 23, 2024 09:29

tgodzik reviewed Apr 25, 2024

View reviewed changes

kasiaMarek force-pushed the outline-compiler branch from b1bb0e7 to 0656479 Compare April 30, 2024 10:24

kasiaMarek requested a review from tgodzik April 30, 2024 11:22

tgodzik approved these changes May 13, 2024

View reviewed changes

kasiaMarek force-pushed the outline-compiler branch 2 times, most recently from 1f7ab2f to a15c8af Compare May 20, 2024 09:42

tgodzik and others added 6 commits May 20, 2024 13:06

feature: Experiment with outline compielr

2c1ad9f

more outline compiler progress

d5d5857

add new files for outline

401d6bf

adjust for all Scala 2 versions

8d9d235

don't outline before first compilation is done

7e4b45e

outline twice for first compile

1c161df

kasiaMarek added 14 commits May 20, 2024 13:13

test fixes

28a6f7a

restrict when presentation compiler is restarted

61cd2e2

test: add new test

466786d

move logic outline files logic out of pc

73f961a

move outline from Compat + move semanticdbTextDocument to `Compil…

ce23987

…ers`

add buildTargetId to pc

a4e9146

cap numer of files to outline

31366b7

add tests

aee71d8

format

94e7008

reverse moving outline from Compat

31b3282

formatting fix

ff0420b

review fixes

3dfc44a

show only syms from defs

1267738

post rebase fixes

5a327c4

kasiaMarek force-pushed the outline-compiler branch from a15c8af to 5a327c4 Compare May 20, 2024 11:26

kasiaMarek merged commit 76a9a65 into scalameta:main May 20, 2024
23 of 24 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Outline compiler #6114

Outline compiler #6114

kasiaMarek commented Feb 13, 2024 •

edited

tgodzik left a comment

tgodzik Mar 10, 2024

kasiaMarek Mar 19, 2024

kasiaMarek Mar 19, 2024

tgodzik Apr 17, 2024

kasiaMarek commented Mar 20, 2024

tgodzik Apr 17, 2024

kasiaMarek Apr 23, 2024

tgodzik left a comment

tgodzik Apr 22, 2024

tgodzik Apr 22, 2024

tgodzik Apr 22, 2024

kasiaMarek Apr 26, 2024

tgodzik left a comment

		@@ -101,6 +104,10 @@ class Compilers(

		import compilerConfiguration._

		val plugins = new CompilerPlugins()

Outline compiler #6114

Outline compiler #6114

Conversation

kasiaMarek commented Feb 13, 2024 • edited

tgodzik left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

kasiaMarek commented Mar 20, 2024

Choose a reason for hiding this comment

Choose a reason for hiding this comment

tgodzik left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

tgodzik left a comment

Choose a reason for hiding this comment

kasiaMarek commented Feb 13, 2024 •

edited